Grasping Points Determination Using Visual Features
نویسندگان
چکیده
This paper discusses some issues for generating point of contact using visual features. To address these issues, the paper is divided into two sections: visual features extraction and grasp planning. In order to provide a suitable description of object contour, a method for grouping visual features is proposed. A very important aspect of this method is the way knowledge about grasping regions are represented in the extraction process, which is used also as filtering process to exclude all undesirable grasping point (unstable points) and all line segments that do not fit to the fingertip position. Fingertips are modelled as point contact with friction using the theory of polyhedral convex cones. Our approach uses three-finger contact for grasping planar objects. Each set of three candidate of grasping points is formulated as linear constraints and solved using linear programming solvers. Finally, we briefly describe some experiments on a humanoid robot with a stereo camera head and an anthropomorphic robot hand within the ”Centre of excellence on Humanoid Robots: Learning and co-operating Systems” at the University of Karlsruhe and Forchungszentrum Karlsruhe.
منابع مشابه
Associating Grasping with Convolutional Neural Network Features
In this work, we provide a solution for posturing the anthropomorphic Robonaut-2 hand and arm for grasping based on visual information. A mapping from visual features extracted from a convolutional neural network (CNN) to grasp points is learned. We demonstrate that a CNN pre-trained for image classification can be applied to a grasping task based on a small set of grasping examples. Our approa...
متن کاملUsing tactile and visual sensing with a robotic hand
Most robotic hands are either sensorless or lack the ability to accurately and robustly report position and force information relating to contact. This paper describes a robotic hand system that uses a limited set of native joint position and force sensing along with custom designed tactile sensors and real-time vision modules to accurately compute nger contacts and applied forces for grasping ...
متن کاملLearning to grasp using visual information
A scheme for learning to grasp objects using visual information is presented. A system is considered that coordinates a parallel-jaw gripper (hand) and a camera (eye). Given an object, and considering its geometry, the system chooses grasping points, and performs the grasp. The system learns while performing grasping trials. For each grasp we store location parameters that code the locations of...
متن کاملActive learning of visual descriptors for grasping using non-parametric smoothed beta distributions
One of the basic skills for a robot autonomous grasping is to select the appropriate grasping point for an object. Several recent works have shown that it is possible to learn grasping points from different types of features extracted from a single image or frommore complex 3D reconstructions. In the context of learning through experience, this is very convenient, since it does not require a fu...
متن کاملA Novel Method for Content Base Image Retrieval Using Combination of Local and Global Features
Content-based image retrieval (CBIR) has been an active research topic in the last decade. In this paper we proposed an image retrieval method using global and local features. Firstly, for local features extraction, SURF algorithm produces a set of interest points for each image and a set of 64-dimensional descriptors for each interest points and then to use Bag of Visual Words model, a cluster...
متن کامل